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ABSTBACT 

This report describes the naturally occurring 
variations in tiae allocated to reading instruction in eight 
grade-five classes selected as part of the Beginning Teacher 
Evaluation Study. Students coapleted a set of reading tests in early 
and late fall and teachers aaintained records of instructional tiae 
allocated, setting, and content covered. Ceiling effects in the 
reading tests precluded an analysis of the relationship of tiae to 
achieveaent. The tiae data were analyzed to identify variations 
across classes and differences between students within a class in 
teres of tiae allocated to instructional settings and content areas. 
It was found that opportunity to learn varied greatly free one class 
to another and f roa student to student within any given class. Bean 
teacher xatings of student engageaent ccapared reasonably well with 
independently observed class averages of engageaent. (Author/AA) 
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PREFACE 



The Far West Laboratory conducts research for the California Commission 
for Teacher Preparation and Licensing through funds provided by the National 
Institute of Education. The Commission has responsibility for certifying 
teachers and teacher training programs in the State of California. The researcli 
that the Commission sponsors is designed to help them understand what teacher 
behaviors or ias trvc t ional activities are beneficial for students. With d 
reliable knowledge base in this area the Commission and ,the institutions that 
train teachers would be better able to provide training exceriences based on 
empirical findings relating teacher behavior to student achievement. 

In previous years under the Commission's sponsorsl^ip , the Beginning Teacher 
Evaluation Study (BTES) has conducted empirical and methodological research 
on teaching which led to a belief that an important element in the study of 
teaching and learning is instructional time. Time allocated by teachers for 
learning spec if ic academic subject matter showed considerable variation across 
classes, and also varied among students .ithin these clashes. Further, students 
appeared to h qi'ite variable in how engaged they v#ere in their assigned academic 
activities. These major variations in the amount of time students spent learning 
in different t las^ es called for further investigation. During the continuation 
of Phase ^h-a for the Cummission's research effort (1973-76) tlie LaboraLory 
staff was granted permission to explore some of these temporal factors in 
J as true t ion . 

The data ccllected as part of this research activity encompassed one 
SLhool year of instruction in reading and mathematics at grades 2 and A 
number ni approatiies (reported in other BTES documents) to unders I ami nsg the 
relat ionsiiips among tune allocation patterns and student learning havt* been 
attempted. Part ot the work in this area was carried out inder sub--t (MU rac: t 
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to the ML-Group for Policy Studies in Education, CEMREL, Inc. After collection 
of the data and initial processing by staff of the Var West Li.-.oratory , computer 
tapes containing the data collected on instruction in grade 5 reading were 
transmitted to the ML-Group. This report is based largely on an analysis of 
these data by Annegret Harnischf eger , Raymond E. Pifer, Norma J. Sutton, and 
David E. Wiley. 

Charles Fisher, Richard Marliave, Nikola Filby, and Leonard Cahen of the 
BTES staff desiga^:d the instruments and supervised the data collection in this 
area of the study. Jeffrey Moore, Pat StoVm, and Mark Phillips of tlie BTES 
staff carried out the initial stages of the data processing effort, Marilyn 
Dishaw, Faye Mueller, and Fannie Walton coordinated many of the field activities 
and technical services so necessary for a field study ihat required the . col lect ion 
and processing of large quantities of data from naturaji classroom settings. 
Their efforts, arJ the efforts of the many field workers who assisted witl» the 
data collection are greatly appreciated. 

Jeremy George typed the final copy and Edna Robnett provided valuable 
clerical support. We thank them for their help. 

Our thanks and appreciation go to the teachers and students in California 
schools who continue to support this project by donatin;^ their time and conmients. 
The hard work of many teachers, in addition to their regular classroom respon- 
bibilities, makes this research possible. To each of these ded ic a ted. volunteer 
we owe a special tuinks, 

David C. Berliner 

Pr i nc ipal Investigator 

Beginning Teacher Evaluation Study 

December, 1976 
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I. INTRODUCTION 

The priipary gn-^-i of the Beginning Teacher Evaluation Study is to in- 
vestigate relationships between various aspects of instructional strategies 
and student achievement. Instructional strategies^ refer to the choice of 
curriculum content areas and setting variables. When inplemented , these ^ 
choices result in students spending time on specific content areas in 
specific settings (e.g., small group seatwork on "synonyms" with a teacher 
directly Involved). The organization of such pupil activities over a period 
of time constitutes the in-school instruction for that student. The in- 
struction for students in the tame class differs to the extent that the 
chain-of-activit ies for individual students varies. Prjsumably the liomogenity 
of t'lese chains-of-ac tivities differs from one class to another. How much 
do'es instruction differ from one class to another and from one student to 
another in the same class? The examination of time allocation patterns 
can answer this question. The description of patterns of rime allocation 
to $ubcategories of subject matter and classroom setting bo-:h within and 
across classes is a major goal of the work reported in chis document. 

M)ifferences in time allocation patterns are potentially related to 
differences in student achievement. Within certain ranges, it is reasonable 
to expect that more time allocated to a content area will result in more 
achit'V^ement in tiiat area. This relationship may be relatively strong or 

i 

weak depending upon a variety of other conditions (specific teacher in- 
structional beha"iors, curriculum materials characteristics, etc.). The 
second major goal of this work segment is to examine the relationship 
between patterns of time allocation and changes in student achievement. 

During the cut\t inuat io!i of Phase III-A of the Uegianing Teacl^er Kvaluation 
Study (Fur West Laboratory, 1975), data were collected in icmr separate* 
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samples of approximately eight classes each. Data on reading instruction 
at grade 2 .and mathematics instruction at grade 2 came from two of the 
samples. The other two samples yielded data on reading and mathematics 
instruction at grade 5. This report^ deals exclusively with the data 
collected on reading instruction in the grade 5 sample* 

In keeping with the goals of Phase III-A, an important function of this 
exploratory study was to provide experience in collected and aralyzing data 
on instructional time. The information on time allocation and the utility 
of various data collection devices is intended to facilitate the design 
and conduct of P^ase III-B of the Beginning Teacher Evaluation Study. 

^ For an analysis of teaching-learning processes in elementary school 
classrooms see Harnischf eger and Wiley (1975a, b) . 

^ For other reports on analyses on time allocation and student achieve- 
ment conducted as part of Phase III-A of the Beginning Teacher 
Evaluation Study see Filby and Dishaw (1976) and Fisher (1976a, b) . 
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II. DESIGN AND INSTRUMENTATION 

Si* 

Desir 

The objectives of this study were to describe the naturally occurring 
variations in time allocated in reading instruction in a sample of grade 5 
classes, and to relate these variations to variations in student achievement. 
No manipulation of* classroom conditions or teacher behaviors was attempted. 
The strategy was simply to assess student achievement in a nuftjer of content 
areas on two occasions; once early in^'the fall and once late in the fall. 
In the intertest interval, records of allocated time were kept. The inter- 
test period was chosen in such a way that a maximum* interval (about 40 days 
of instruction) was available without inconvenience to schools during the 
first two weeks of classes or the week preceding Christmas vacation. It 
was also necessaty to have approximately ten days at the beginning of the 
school year for contacting teachers and ins*:ructing them in procedures for 
keeping records of allocated time. These practical' time constraints 
determined that the first testing occasion' (referred to as occasion A) 
take place during the first week of October, 1975. Records of allocated 
time were kept for eight weeks of instruction, after which the second test- 
ing (occasion B) was conducted during the first week of December, 1975.- 

Measures of Reading . ^^ment 

The measures of reading achievement used in tliis study are a subset of 
the reading scales being developed by the staff of the Beginning Teacher 
Evaluation Study. In.orim versions of scales^ being refined for Phase III-B 
were used. 

A large battery of reading items were ddministered at occasions A and 
B. The battery contained 284 items grouped into approximately three dozen 
subscales each assessing achievement in a specific rcriding content arva 

JO 



-4- 

commonly taught at grade 5 in California schools. With the exception of a 
small number of items (for example, word division in the compound words 
subscale) , all items were of the multiple choJce type. All items were group- 
administered. Scores were corrected for guessing using the standard corrertion 
procedure (Thorndike, 1971). Although some tests were short, the internal 
consistencies were relatively high. Identical items were administered at 
occasions A -and B and the resultant scores were used in conjunction with time 
measur^es assessed over the inten'ening eight week interval. 

Process Variab l es 

The process data consisted of measures of allocatec time spent in 
particular reading content areas. In addition to content areas, several 
instructional settings were distinguished. Allocated time was assessed 
by a log-keeping procedure. This section of the report describes the 
subject-matter and setting categories and the teacher log procedure. The 
final protion oi this section describes procedures used in deriving an in~ 
dt'X of student engagement. 

Subiec t-matter and instructional setting categories . Since instruction is 
planned and implemented by content area, and since student achievement is 
most often differentiated by content area, instructional time was first 
partitioned by content category. Subareas of reading (e.g., decoding, word 
meaning, comprehending main ideas) constitute the categories. Reading 
content categories were developed at two levels; general and specific 
They wer€^ derived from a logical analysis of reading objectives, textbooks, 
and curriculum materials. The original categories were modified and refined^ 
-by classroom teachers during piloting. 

For grade 3 re<uiing, 68 speciiLc content categories^ weto defined. 
(All content categories *are listed in Appendix a. Table A. '3). Specifit' 
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content Cdr;egorie3 were developed so that al located . t ime euuld be recorded in 
relatively narrow categories. 

In aodition to the content categories, broad instructional settings wefi* 
defined by three fundanental instructional characteristics: adult i nvoi veiiien t , 
pacing, and grcup size. 

The teacher- iiivoivement facet had two elements. Settings in which students 
worked directly with a teacher (or other adult) were d ist nu^u i shed from settings 
in which a teacher's primary attention was not directed toward the students being 
considered. Thi i facet is important because the impact ot a teacher's interactive 
behavfors and ills operates in the former but not the latter type of setting. 
(The term "teacher" was used in the broad sense, to include any adult directly 
involved in instruction.) If a class was divided into two groups at some point 
in time, and one of the groups was engaged in wurd drill with the teacher whiU» 
the other group was doing seatwork, the students in the drill accivity were in 
a setting with direct teacher involvement. The students v?ho were doing eatwork 
\'o^e in a s'^tting v/hich did not involve a teacher directly, even though the teaclier 
may have oc^asionallv addressed one or more of them. If students were engaged in 
seatwork, and the teacher's main activity consisted of going from student to 
student to check or explain work, the teacher was cliarac ter Iztd as directly 
involved, even though he did not interact with all students in the group. 

The pa ing i.-cet'sA/as in( ludcd to distinguish between settings in whiiij 
students proceeded at their own pace and settings in which they worked at a pace 
determined by the teaclier (or some other characteristic of instruction). Pacing 
is very mucli ci matti^r of degree; students nev(*r completely determine tlieir t)wn 
pat^e, nor is pate totally determined by external tactots. Never t he 1 i'^^s , in- 
structional setrin/.- vary lonsiderahly in this rrspet t ; and, as a result, tiie rate 
of student learning may be strongly affected. As a crude operal lonal i /at ion u\ 
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pacing, a distinction was made between $eatwork and group work» Seatwork is 
the most frequently occurring setting in which students have relatively high 
control over pace; gr( up work is the situation which is most externally paced. 

The third facet of instFuctio^- - . was group size. This facet lias 

been the subject of much research and has great intuitive appeal. It was 
included here, not because of its potent ial. direct effect on learning^ but because 
different group sizes provide the oppoVtunity for v^ry different kinds of student 
activities, teacher behaviors, and group climates. The mere fact that a student 
I:. Wi)rkiug in a small group does not imply that a particular kind of instruction 
will occur; it doej'. act as a necessary (but not sufficient) condition for certa 
highly-valued teacher behaviors. For instance, the smaller the group, the more 
closely a teacaer can approximate a tutoring situation wrth each .sLrdeut . however 
a lecture to a group of five children is piotiably very much like a lecture to, 
a group of 35 children. Group^^lze, like the facets of setting, was Loaed as 
a dichotomy. Large groups were defined to contain 10 or more students; small 
grodp-^, nine or fewer. Pilot experience showed taat a lower value for tlu- 
upper bound of '*small groups" woulJ have provided very little discrimination amon^ 
atCUiil t ] is-^roum groups. 

TeaUu'r Io ^;s . The teacher Jogs were developed by the stc-ff of the Beginning 

I 

Tea*, ru r lA'aJuaLion Study. Ine logs served as the primary Source for collecting 
dfta Du allocj.etl r un<' . The development of practical methods for coiiectmg 
information on allocated time was, in itself, an important objective of the work 
carried out during tlie vontinuation year^of Phase Ill-A of the 'icginniug Teacher 
r 'a luat i on Studv . 

All participating teachers maintained records of Lime al!i>cated U> reading 

f 4 ' i 

instruct ion. The'^e wv'tj referred to"^ "teacher logs.'' 1 he lo^s provided mi~ 
tormation on content covered* and settiiigs for reading instrurion, on a daily 
for i.\roups of students m enh *^lass. The' t '-ne allocati'd to oat ii 
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instructional setting was recorded, with one or more content categories 
associated with that setting. In highly individualized classes, teachers 
recorded the content covered and settings used for each student during 
1 reading instruction. "^1 

The teacher log format is presented in Figure 1. Each one-page log 
covered one week of instruction for a single group of students.. The'names 
of the students \w a given group were designated on the attendance/group 
composition sheet (shown in Figure 2)'. Each teacher listed his class roster 
on the le«:t hand side of the attendance/group composition form. For a given 
week, the teachers then designated the reading instruction group for each 
student and Clie daily attendance. This allowed for changes in the compos it i6n 
of .-.tuderit groups from day to day or from week to week. 

Reading coa.ent was recorded according to the list of categories in 
Appendix A, Teachers referred to the list to find codes for cont^^j^t categories 
that best described the instruction. Teachers were also provided w'th ^ 
glossaries which contained examples of each of the conte'^t categories, and- 
were individually trained in the log keeping procedure. Practice logs were 
kept by each teachers for up to two weeks before data collection began. The 
training and glossary were intended to ensure reliable categorization of 
content from teacher to teacher. 

In classroom situations, content tended to change more quickly than 
setting. For this reason, several content catc^gories were oiten designated 
for one instructional setting. The starting and ending t im^ for each setting 
was recorded, thereby providing a record of the instructional time allocated 
to the content covered in each setting. If several different content ^ 
ca^ juries were recordid for one setting',, (and hence one time period), tl 
teacher specified f he time devoted 'to each c oiiIlmiI Late^;ory whenever possible. 
Otherwise, Ihu toCil time for th-.' setting was distributed equally ainon)^, the 
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content categories, yielding an estimated time allocated to each category. 

The defining characteristics of instructional settings <aduit involvement, 
pacing, and group size) have been described above. Direct involvement of an 
adult covered a range of activities from lecturing to monitoring independent 
seatwork. "Adult" referred to any teacher, student teacher, or aide. The 
same adult was not classified as directly involved in more than one setting at , 
a time. Therefore, an adult would not be classified as directly involved in 
monitoring seatwork if that were a secondary function of the adult. 

Regarding the pacing facet: "seatwork" referred to any setting where 
students worked independently. Two or more students working together, or an 
adult tutoring one student, was classified as a group--work setting. 

The group size facet was not recorded by teachers. This categorization was 
made by coders when the teacher logs were returned to the Laboratory for pro- 
cessing. Croup size was ascertained by ciiecking tju^ number of students in a 
particular group on the attendance/group composition form. 

In addition to the information noted above, teachers provided a. brief 
description of tlie materials used in each instructional setting; tiie name of 
a textbook and the pages covered, worksheets used for seatwork assignments, and 
the 1 ike. 

In summary: for a given week, each teacher recorded how students were 
grouped for reading; instruction on the attendance/group composition farm. 
Daily absence recordr were kept on the same form; and if group composition 
changed during the week, the changes were also reported. On tiie teacher log 
form it^ielf , tcctchers kept daily records for each student group. For x^ach day, 
time periods were hlo(.kod off by vertical lines (drawn by the teacher). The 
beginning and endrfi^ times for a setting were recorded along tiie top of the form. 
For eacii setting, ::eac!iers recorded adult involvement, pacing, materials, and 
content categories. In this way, varied instructional patterns could he recorded 
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on the same form. 

Where teachers grouped students for instruction, this procedure worked 
well. Where instraction was highly individualized, variations were adopted. 
This most often required the keeping of records for individual students; or, 
where teachers operated a number of "activity stations," records could be 
kept for each station. 

Since the log procedures were quite new, relatively little was known 
before the study about their measurement characteristics. Therefore, in order 
to obtain independent assessments of allocated time, additional data were 
collected. Far West Laboratory coders, who transferred the raw teacher logs 
into machinc-punchabie formats, spent one day in each class-room. During that 
day, the coders completed a log for the reading instruction that occurred. 
This log was then available for comparison with the teacher log for the same 
day. Since there was only one day of coder log per teacher, these data werQ 
treated in a clinical manner. 

Student engagement . The time allocated to a content-setting combination 
represents an upper limit for the time a student may work during school on 
that area. Howe\er, students do not necessarily spend all of the time working 
at the intendecl task or activity. As a result, the* time allocated to a content- 
betting combination may be thought of as partly engaged tln.e and partly un- 
engaged time. The amount of engaged time spent in a particular content-setting 
combination varies Irom student to student. Since these differences are of 
interest in themselves and since engaged time is theoretically related to 
student outcomes, an assessment of engaged time was attempted. 

The procedure was based on adjusted te acher ratings of student attentive- 
ness . Teachers were asked to rate each student in terms of the percent of the 
time which the student paid attention during class. These ratings were made 
twice; once for instructional settings where an adult was directly involved, 
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and once for setti.igs where no adult was directly involved. The percent 
attentiveness ratings were made by placing a check in one of nine categories, 
where each category represented an increment of 10 percent on a zero percent 
to 100 percent scale. The directions to teachers and the two rating forms 
are 'included in Appendix A. (By an oversight, the category representing 31 
to 40 percent was omitted from the form.) 

The teacher r;?tings of attentiveness were assigned the mid-categcry value; 
that is, a check in the 81-90 percent category was assigned a value of 0,85. 

This provided a distribution of attentiveness scores for eacli class. However, 

( 

J 

comparison from one class to another would be hazardous, since ertora due to 
teachers' tendencies to rate high or low would appear as between-class differences. 
In an attempt to correct for possible teacher bias, class estimates of mean 
engagement were made. 

The estimates were basea on data collected during instruction in reading. 
An observer visited each class for one day* During the reading instruction 
periods, the observer counted the number of students engaged and tlie total number 
of students nominally working on reading. This procedure was repeated every four 
minutes. In this manner, average class engagement estimates were calculated 
' ^ (see Table A. 2, Appendix A). ^ ' 

Samplt.- aad File (iharac terist ics 

The field work tarri-d out by Far West Laboratory during the conL inua t ion 
year of Phase III -A of the Beginning Teacher Evaluation Study (see Far West 
Laboratory, 197 5) involved a sample of 33 teachers. This sample was composed of 
16 grade 5 and 17 ^,rade I teachers. Kach volunteered to participate in the one- 
year study. 

The teachers wt>re recruited in the San Francisco Bay A^ea by Far West 

-J 
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Laboratory staff during the spring of 1975. After meetings with administrative 

officials and holding principals in ten districts, individual teachers were 

contacted. The study was described, and teachers were offered extension credits 

(through a cooperating college) or an honorarium for their participation. 

In September of 1975, it was decided to conduct the reading and mathematics 

studies with separate samples of teachers. The teachers at both grade levels 
f — 

c^se to participate in either the reading or the mathematics sample. 

; Teachers in this study completed a remarkable amount of work in connection 
with the study. (The work reported here Is based on data collected over 
approximately 10 weeks of instruction during the fall of 1975; the teachers 
continued to contribute to other facets of the Beginning Teacher Evaluation Study 
through the spring of 1976.) Each teacher received either a $50 honorarium or 
four extension credits for participating in the study. They were paid $10 per 
week for th'^ completion of teacher logs (kept over a period of approx imately^l2 
weeks) . 

The sample included one male teacher, the remainder were female; all had 
several years experience in teaching. Several of the classes were split grades, 
containing some gride 4 (or grade 6) students and some grade 5 students. Only 
grade 5 students (but no necessarily all grade 5 students in a given class) 
were included in the study. Of the grade 5 students in a class, teachers were 
asked to identify those who were reading at a level below grade 4. Since 
the low reading level would have made it difficult to test these students 
reliably, they were not tested, nor were they followed via the log procedure. 
At the initial tesllng, it became clear that several other students were not 
able to complete the tests. These students were also dropped from Mie study. 
Students who were tisted hut for v\., . the tests were too difficult were 
designated ''not followed" in the initial data matrlcies. Those for whom 
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test data and log data were collected were designated "followed." Midway 
through the study one class was dropped because the log data were not returned 
regularly. 

Thus, the useable sarple consisted of eight fifth grade classes from 
seven elementary schools. The major portion of the data was stored on tape 
ill fear district files: 

File A - the first data file, contained aggregate time allocation in- 
formation on 145 children. The aggregate data were in the 
form of 68 (content areas) x 8 (instructional settings) 
matrices, one matrix for every child. 

File B - the second data file, contained pre- and posttest scores on 
21b children. Results of 35 distinct reading subtests were 
included, together with five summary scales. 

File C - the third data file, contained teacher rating information 
un pupil engagement for 146 children. Two ratings were 
assigned to each child; one for an "adult present" in- 
structional setting, the other for a "no adult present" 
sett ing . 

File D - This file was created by merging files A, and C. The 

merf^ed file consisted of 118 students who were able to pass 
four selection cri.^ria that were applied in a sequential 
fashio!!. Trie criteria and the number of studt^nts who 
failed them are: a student who is represented in one file 
,r.houId be represented in tlie other two files (71 failures); 
LMch student's status at the "A" and "H" testinj^ occasions 
-;houid be "followed" (4 failures); a student should have 
complete dala on all pre- and post-subtests (21 failure^s); 
l^nd a student sliould have been assi);ned l)Oth an "adult 
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present" and "no adult present'* engagement rating by his 



teacher failures). Using this ptocedure a total of 98 



children were not accepted for the merger. The students 



in Files A and C constitute proper subsets of File B. 



Some analyses were performed on each of Files A, B, and C, other analyses were 
performed on File D. Table 1 describes the sizes of these files. 

We had set out to examine the relation of teaching strategies and curric- 
ular choices to achievement. The data on reading instruction from eight fifth 
grade classes (collected over a 40 day period, with pre- and posttesting) made 
up our working material. After initio,! analyses, we realized that it would 
not be completely appropriate to trace pupils' classroom activities to their 
achievement in this data set. The reason: the value of the reading achievement 
scales was severely diminished by a "ce^iling effect." Out of eight classes, 
four were already achieving at „a very high level at the time of pie-testing. 
Therefore, these students could not show large gains. As a consequence, tlie 
measurement of gain in reading achievement was, in many cases, of very limited 
use. No valid inferences could be drawn relating achievement and classroom 
instruction without considerable additional resources and extensive analyses 
of test item data. 

Analyses were restricted to the extraction and formulation of teaching/ 
learning characterizations potentially related to achievement, and thus to 
teacher performance and resource allocation. Since we believe this to be an 
important approach to understanding classroom data, most of the work is purely 
descriptive. The smajl sample size (eight classes) encouraged this approach, 
which is typically employed only in case studies. However, in some instances, 
it was possible to perform relational analyses between time and ach ievt'itu'nt . 

As a guide for future data collection and analysis, we present in- this 
report, a lumber of new and Interesting characterii'.ations of classrooir 



ERIC 




-16- 



Table 1 
Summary of Data Files 

Membership Frequencies 



School 


Class 


Teacher 


File A 


File B 


File C 


File D 


1 


1 


1 


25 


27 


25 


22 


2 


2 


2 


19 


:8 


19 


17 


3 


3 


3 


10 


10 


10 


9 


3 


/ 

H 


4 






io 


Id 


4 


b 


5 


16 


18 


16 


16 


9 


6 


10 


22 


34 


22 


15 


11 


7 


12 


19 


33 


20 


9 


12^ 


7a 


14 


0 


30 


0 


0 


13 


8 


15 


16 


18 


16 


14 


Totals 






145 


216 


146 


118 



1 This row represents a class for which there were test data, but 
not log data. The class was dropped from further consideration 
in this report. 
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processes. Each of these is exploratory in nature and is intended to indicate 
potentially useful perspective? on time allocation data. 



^ The- history of development and data from pilot testing of the items are 
included in Technical Report III-l: Development and Refinement of Reading 
and Mathematics Tests for the Study of fading and Mathematics Instruction 
i n Grades 2 and 5 (Filby & Dishaw, 1975). For a description of further 
refinement of the tests through an analysis of reactivity using the current 
data set, see Filby and Dishaw (1976). 

^ The content category systern had a primary use related to the study of test 
reactivity (Filby & Dishaw, 1976). For this purpose the categories were 
designed to encompass the entire grade 5 curriculum. 
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III . RESULTS 

Classroom Characteristic s 

Classes were characterized in ways that neither exhaust nor always 
adequately mirror the set of teaching/learning process constructs we feel to 
be important. The first set of characteristics (Table 2) shows reading achieve 
ment levels at tl;e inception of this investigation. ''Class size" is an in- 
stitutional factor; the other columns in the table describe typical individual 
pupils . 

We view the first of these, 'Wan composite score on the pre-test," as 
possessing the greatest descriptive value. It reflects initial achievement. 
The corresponding posttcst score edible 7) was intended to allow assessment 
of intervening leatnings. However, ceiling effects decreased the value uf 
this variable. As test scores approach their maximum, increases in actual 
achievement result in increasinRly smaller measured increments. This effect 
is signaled by large drops j4> the standard deviations of the posttest score 
distr Lbtuions, When small score variability accompanies high mean scores in 
a class, one can be fairly certain that ceiling effects are present. Hert. 
(in Tables I and 7), these effects are exhibited most strongly by classes 3 
and 4, and to a lesser degree by classes 1 and 2. 

The ^ harac terisLlcs shown in Table 3 relate to tiie ins true t iona J strategi 
usx'd by loachtT^. All variables included in the table reflect teachers' 
grouping and content-selection patterns. The first two, "number of content- 
setting combinations used" and "variety in Coverage," indicate teacher choices 
about the presentation of content and organizatioo of instruction. "Number of 
content x setting areas taught to all pupils" and "commonality in coverage," 
show the extent to which a teacher's content-setting comhiriations were used 
with all "followed" children in the class. 



• Table 2 

Initial Reading Characteristics of elite ses 

Standard , Mean Composite Score 

Me^n Composite De\/iai ion ot Composite on Pre-test as a 

C lass Class Slz-^ Score on Pre~Test^ Score on Pre~test^ Percent of Maximum Score ^ » ^ 

9 



1 


26 


200.94 


41.43 


70 


.75. 


2 


.8 


201.86 


49.39 


71 


.08 


3 


273 




12.53 


83 


.93 


4 


31^ 


249.85 


11.16 


87 


.98 


5 


'21^ 


134.41 


61.92 


47 


.33 


b 


3^ 


67.60' 


44.51 ♦ 


23 


.80 


7 


34 


il6.45 - 


66.98 


41 


.00 


8 


28 


163.82 


60^.69 


57 


.68 


Results 


are based 


on data file D. 








MaxiT.un 


possible 


score is 284. 








Only 11 


students 


in this class participated 


in the study. 







T'lcre were :3 fourt':; and 18 fifth graders in this class. All of the fifth graders v/ere followed 
in tl:e study. 

^ Twenty studctpts m this class participated in the study. 

- Thtse wlass sizes vere recorded during the first week of school. In some cases (e.g., Classes 1 
and^6), additional pupils Vs'ere enrolled before testing began (see Table 1). 



Table 3 



Reading Instructional Cover£.ge Style 

* Variety in Coverage; Coinmonality in Coverage: 

Number of Reading Number of Content x Setting 

Content x Setting ' ' Areas Taught to All Pupils 

Number of Areas Used as a Number of Content x as a Percent of Number of 

Content x Setting Percent of Total Setting Areas Taught Content x Setting Areas 

Class Areps Used^ Possibly Used^*^ to all Puj)ils^ Taught to Some Pupils^ 

C X S Content Setting C x S €ontent Setting 



1 


67 


33 


4 


' 12 


.32 


-48.53 


50 


.uo 


50 


74.63 


2 


104 


41 


6 


19 


.12 


60.29 


"5 


.CO 


7 


6.73 


3 


143 


55 


+ 


26 


.29 


80.88 


50 


.00 


115 


80.42 


4 


105 


45 


4 


19 


.30 


66.18 


5'0 


.00 


98 


93.33 


5 


116 


54 


7 


21 


.32 


79.41 


87 


.50 


48 


41.38 


6 


94 


40 


8 


17 


.28 


58.82 


100 


.00 


26 


27.66 


7 


105 


44 




19 


.30 


64.71 


75 


.00 


11 


10.48 


8 


8d 






lb 


.18 


64.71 


75 


.00 


24 


27 .27 



Results are based on data file A. 

MaxiTium possiDie value of Content x Setting Areas is 544. 
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Whiie it may be rea;>unable to expect , that high values for these variables 
indicate instruction of the whole-group type, this is not logically necessary; 
a teacher with preferences for small group and tutorial settings could in- 
dividually direct all or most of her students to a common selection of content 
setting combinations. We will discuss this issue more fully below. 

Different rates of student absenteeism contribute to differences in the 
degree of implementation of teacher preferences about content-setting com- 
binations. Therefore, the data presented in Table 3 must no^: be taken as "pure" 
induatois of strategy; rather, they reflect actual teaching . 

Table 4 presents data about resource allocations that determine tlie 
quantity of schuoi ing received by pupils.' The first two characteristics, 
"maximal exposure to ic struc tion"^ and "average teacher aide assistance" are 
related to institutional factors beyond an individual teacher's control; factors 
which exert powerful influences on a teacher's activities and, coi.sequent ] y , 
o'n pupil pursuitj:. The first variable sets an upper limit on the total 
quantity which could have been allocated to the broad curricular area of 
"reading." The second variable indicates the amount of aide^assistance 
available. The remaining variables convey basic information about alloc.it ions 
of lime to instruction in reading. iiecciuse we suspect tliat coding errors 
s.'riour>ly affected tlie observed time aiiooations in "teading-related" content 
areas, the "mean dirett reading instruction" variable will be relie'd upon for 
the best picture of class differences, since this variable omits time iu^ 
"reading-related" areas. The last variable in Table 4, "me n reading instruction 
in basic tested content areas," provides an indication of che amount of time 
allocated to those eJ enieiital content areas for which we were able to find 
corrt'sponding subtest scores. Table A.i in Appendix A provides a key tt) the 
relationships betwe-n the last three variables of this table. 
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Table A 



Basic Instructional Time Allocations 



Class 



Maximal Possible Exposure 
CO Instruction During the 
Studjy Period' 



1 



Hours Hours/Day 



Average Teacher Aide Assistance^ 

t^urs Hours /Day % of Maxima] 

Possible Exposure 
to Instruction 



1 


220.0 


5.500 


0 




0 


0 ■ 


2 


■230.0 


5.750 


40.0 


1 


.000 


17.39 


3 


220.0 


5.500 


0 




0 


0 . 


4 


220.0 


5. 500 


0 




0 


0 


5 


216.7 


5.417 


140.0 


3 


.500 


64.62 


6 


216.7 


5.417 


80.0 


i» 

z 


.000 


'36.92 


7 


220.0 


5 . 500 


220.0 


5 


.500 


100.00 


8 


■213.3 


5.333 


133.3 


3 


.333' 


62.50 




Mean Direct 


Reading 


2 

Instruc tion 






Mean Reading 



Mean heading and Reading-Related Instruction^ 

Hours Hours /Day 'A of Maximal Possible 

Exposure to Instruction 



71.41 

26.71 

89.37 

86.82/ 

59^ 

59.24 

38.13 

61.38 



1.785 
.668 
2.234 
2.171 
1.486 
1.481 
.953 
;.535 



32.46 
11.61 
40.62 
39.46 
27.43 
27.34 
17.33 
28.77 



of Maximal Possible 



Mean Reading Instruction in Basic, Tested, Content Areas ' 

% of Maximal Possible 



ass 


Hours 


Hours/Day 


Exposure to Instruction 


Hours 


Hours/Day 


Exposure to Instruction 


1 


34.68 


.8669 


15.76 


26.12 


.6530 


11.87 




21.38 


.5346 


9.30 


12.08 


.3019 


5.25 


3 


58.27 


, 1.456'^ 


26.49 


37.91 


.9479 


17.23 


4 


57.46 


1.4365 


26.12 


34.56 


.8639 


15.71 


5 


28.01 


.7001 


1?.93 


14.66 


.3664 


6.76 


6 


34.08 


.8520 


15.73 


14.10 


.3526 


6.51 


7 


22.60 


.5649 


10.27 


12.51 


.3129 


5.6C) 




49.25 


1.2312 


23.08 


21.54 


.5386 


10. ID 



^ Results are based on data collected bv interv 

Results are based on data file A. 
^ Results are based on data file D. 
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Table 5 describes teachers' use of learning settings. Tiie "time allocated 
to instruction in reading fundamentals as a percent of tiitfe allocated to direct 
reading instruction" has been included to demonstrate the relative extent of 
each teacher's emphasis on the more basic and fundamental areas of decoding, 
content clues, and word structure. 

The characteristics presented in Table 6 are related to pupil participation 
in learning activities. The first four v?'iables, "total number of absent days," 
"mean number of absent days," "number of children absent one or more days," 
and "percentage of incidence of absenteeisms,"^ reflect basic student attendance 
levels. ' It is obvious that if a student is not present when a teacher teaches 
a curricular area, !ie/she cannot learn about that area as a result of the 
instruction. The next two variables, "mean teacher rating of student cMigage- 
ment" and "observer's class rating of engagement," are taken to be class-level 
indicators of thn extent of student involvement,^ The remaining variables all 
represent "adjusted" class level measures of "effective study time," i,e,, 
estimated amounts of time that students were actively engaged in learning the 
material that the teacher wanted them to learn. ^ The "basic tested" time refers 
to those time allocations which directly match the achievement subtests. 

The variables exhibited in Table 7 are all relateH to pupil posttest 
achievement. The first three variables parallel those in Table 2, ^'Gain" and 
"average points gaiutid in test score per average hour of instruction in basic, 
tested, content areas," were included to indicate grossly the fruits of time 
investments in reading over the eight week period of the study. The gain scores 
are simple averages of post- minus pre-test scores. The last variable is "rate 
of gain,"^ 

Comparative Characterizations of Qlass rooms 

Teachers face a complex environment within which they must make decisions, 

ErJc • 34 
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Table 5 



3 
4 
3 
6 
7 
8 



Relative Time Allocations to 
Basic Instructional Organizations in Curricular Areas 



Time Allocated to 
Small Group Instruction 
in Reading as a Percent 
of Time Allocated to Direct 
Class Reading Instruction^ 



Time Allocated to 

Adult Supervised Instruction 

in Reading as a Percent 

of Time Allocated to Direct 



0 

63.86 
.70 
0 

58.28 
21.05 
79.37 
18.08 



Reading Instruction 



32.06 
63.44 
89.63 
33.81 
33.90 
83.72 
56.18 
77.50 



Class 



Time Allocated to 
Seatwork Instruction 
in Reading as a Percent 
of Time Allocated to 
Direct Reading Instruction^ 



Time Allocated to 
Instruction in Reading 
Fundamentals as a Percent 
of Time Allocated to 
Direct Reading Instruction^ 



i 
4 
3 
6 
7 
8 



67.16 
73.62 
44.26 
61.80 
69.91 
36.71 
63.01 
85.41 



3.48 
4.43 
19.22 
11.70 
30.05 
22.75 
21.08 
13.64 



^ Results are hn^.ed on data file A. 
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Table 6 



Extent of Pupil Participation in the Learning of Reading 





lULaX iNuniDer 




Numb e r of 


Percentage of Mean Teacher 


Observer ' s 






of A hspn t 

KJ A. C\ Ly ilJ i I 1, 


Children Absent 


Incidence of Rating of 


Class Rating 


place 


n a \r G ^ 


Days^ 


Onp or more Davs 


Absenteeisms'^ Student Engagement^ of Engagement 


1 


21 


.C08 


9 


34.62 .69 


.57 


2 


33 


1.179 


11 


^ 39.29 .79 


.79 


3 


9 


.818 


4 


36.36 .85 


.76 


4 


7 


.389 


4 


22.22 .84 


.74 


5 


12 


- .600 


6 


30.00 .59 


.65 


A 

V 




1 .485 


16 


' 48 . 48 . 63 


.73 


7 


25 


.735 


11 


32.35 .57 


" .'57 


8 


27 


.964 


10 


35.71 .52 
« 


.66 










- 

Mean Overall Teacher 


Observer Estimated 










Es t ima t ed , Ef f ec t ive 


Effective Reading 




Mean Overall, Teacher 


iLyL^oCLVCl. HioLX ilia t> 


Study Time for Pupils 


Study Time for Class 




Estimated , Effective 


Over a 1 1 Kf f pp t i vp 


in Basic, Tested, 


in Basic, Tested, 




Reading Study 




RpflHino StiiHv 


Rpadinff Cnnt'pnr Atp3«; 


Reading Content. Areas 


Class 


Time for Pupils in Hours 




Hours in Hcurs 


in Hours^ 




48.90 




40.60 


17.91 


14.89 


2 


21.22 




21.24 


9 . 54 


9 .18 


3 


76.14 




68.51 


32.02 


28.82 


4 


73.19 




64.16 


29.18 


25.57 


5 


35.15 




38.64 


8.69 


9.53 


6 


37.57 




43.41 


8 .80 


10.30 


7 


23.18 




22.92 


7.36 


7.13 


8 


31.33 




40.30 


11.08 


14.22 


^ Figures on tardinesses are not included. 






*^u* 


nbers in this colunn are calculated by dividing by 


the nunber students followed in 


a class* 



Results are based on aata file D. 
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Table 7 



Reading Outcome Chracteristlcs of Classes 



Class 



I 

2 
3 
4 

3 
6 
7 
8 



Mean . 
Composite 
Score on 
Post -lest^ 



Standard 
Devi.ation of 
Composite Score 
on Post-test^ 



219.82 
217.19 
244.99 
256.78 
157.72 
103.96 
132.50 
173.74 



38.68 
45.27 
15.95 
16.80 
61.24 
61.33 
66.06 
67.02 



Mean 

Composite Score 
on Post-test a^- a 
Percent of 



Maximum Score 



1,2 



Gain 



1 



Average Points Gained in 
Test Score per Average 
Hour of Instruction 
Jaslc. Tested, Content Areas 



77.40 
76.48 
86.26 
90.42 
55.54 
36.61 
46.65 
61.18 



18.88 
15.33 
6.63 
6.93 
23.31 
36.36 
16.05 
9.92 



.7228 
1.2690 

.1749 

.2005 
1.5900 
2.5787 
1.2830 

.4605 



^ Results are based on data file D, 



MaKi-^um possible score is 284. 
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For example, groups of pupils differ in their individual preparedness as well 
as in general level of preparation for learning; instructional resources (both 
human and material) vary greatly in quantity and type; and teachers are differ- 
entially prepared (both by training and experience) to prefer and to effectively 
implement various classroom activities. In addition, organizational configur- 
ations beyond the classroom, such as school and district -time schedules and 
programs that require the removal of pupils from classrooms, delimit and con- 
strain a teacher's decision-making. In this section, we will lay out tlie 
availabLe data bvMring on these conditions in order to clarify the range of ^ 
choices. We will also ej.plore consequences of these strategic decisions for 
pupil learning. 

Pupil preparation for learning . In our sanple, the pupils' initial achievements 
in reading varied considerably from class to class (Table 2). In tlie sixth cla^^s- 
room*, a typical pupil cor*-ectly answered only about 24 percent of the test items; 
while in the fourth, the performance le\el was more than three and a half times 
greater (88%). The classes can be divided into two broad groups: those with 
relatively good preparation (Classes 1, 2, 3, and 4)! a^id those more poorly 
prepa.red (CJasses 5, 6, 7, and 8; oetween 20 and 60 percent correct responses). 

Unfortunately, because of the test ceiling effects, it is difficult to judge 
whether teachers wore faced with within-class differences in preparedness. But 
given tlie prominerce of ceiling effects, the relationship- between test standard 
deviation and test mea,ii for the classes seems to be typical of classrooms that 
do not vary greatly in homogeneity of preparation. 

Resources of teachinR . One of the largest influi-nces on teaching decisions is 
the availability of additional classroom personnel, i.e., teaoijing aides. Kor 
the clasi:>e^> iiivfst i ^^itcd , Lhe quantity of this resource^ varied enormous Iv Three 
classes (1, 3, and 4) had no aides at all; one class (7) had a fulJ-time person; 
the remaining teachers had dssistance from ahoal 17 percent of the time (Class 1") 



-28- ! 

to b5 percent (Clas^ '>) . The classes witii better prepured pupils had 'ittie or, • 
no aide time. Those classes with lower initial achi evemt^at_LtiV<^^s^ere pbovided 
with significant amounts of aide time. We can, on the ba. is of prepiirXl ion and 

^ 

resources , place each class ir^^ne of tihree groups: " 

a. well-prepared pupils - no aides (I, 3, 4); l--^. 

b. poorly-prepared pupils - aide ass istance ( S , 6, 7, 8); and 

c. wel J -prepared pupils - m*inimai aide assistance (2). 

Curritular and setting commonal ities. The percentage of contt^nt-sett i ng com- 
binations which were actually used (and to which ail pupils werti exposed) was 
one uf the measures of the commonality of pupil pursuits within a chis^..' (Sec 
section on "Classroom Char ter ist ics . ") Admittedly, this is an imperfect index 
of tht.' commonality of pupils* classroom expediences. One wuuki preler an index 
wiJLch reflects not only the extent to which all pupils were exposed Lo a co'miuMi 
set ot experiences, but also whether the degrees of exposure were homiigeneou. > 
Ihis nore eomplex assessment would require derivation of an index ol sinii iar ity 
of time allocations Lo content-setting combinations. Classroom summariL-^ of siieli 
afi index comparing [>upils would yield a better characterization of the degree 
uf io.rmonai it\ m pupil experiences. The current index suffers, tlien^, from lack 
of n preseiitat ion of actual time allocations. However, an inspection o! the 
houiogenelty within classes of time allocations across content-setting categories 
among pupils rtveals a close relation between the curreiit inde>s and the uegree 
of iiomugc^n.'i L% in the allocations. T> it is reasonable that results similar 

to thosf cited below would be obtained with a more adequate, time-based Index. 

Within each i)f our thr e resource- and participation-based t lai.s .Moupings, 
thete is a jrtl iiig cohesivoness Ml the differential amounts of «*nnii!f(Miai i t y ol 
pupil experience', v^-ithi- the classes. ih;^ single class {l^ with we 1 1 - i)r epa r ed 
pupils and a !nLniin<il amount of aide supvxirt had the least eommunal itv in ,Hipil 
experiences. The three Llas.>es (1, \ and 4) with well-prepared pupils i>ut iu> 
aide support showed t[\e greatest homogeneity in pupil I'xper ien*' ^ . Imailv, t ht 
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four classes (5, 6, 7, and 8) wi.th -e^:s well-prepar^ pupils but signif itani 
aide support exhibited only moderate to low commonaLity of pupil exprr icm es . 

Thus, the degree of individualizatioii strongly related to av<i liable re- 
sources and pupil preparation. The most provocative aspect of tfiis resull is tiie 
clear differences m commonality between classes with aide support and those 
without. But it#would be unwise to overemphasize this finding for su Miiall a 
sample. 

Ciassroon ? provid* some additional food for thought. It 'la.s [)een 
qualitatively described as the most individualized of the classes; <ind clearly it 
is,' if our index has any validity. We have no inform tion, however, on why this 
level of individualization might have come abouc. Did this particular teaclier 
have special t^^aining or preferences? Does ev^n rainimal aide support bwe potent 
impac't in wel 1 -prepared classes? We do not know. 

Allocation of time to settings . A very roi gh measure of diversity in pupil 
experience is tlie extent to which, large-group instruction is ased . At one 
extreme,' who 1 e-t ias.--, instruction preclude:^ differentiation in tiie pupils* exposure 
CO particHilar content are^is.' Thus, there shoald be <i strong relation between 
the amount of tjme allocated to either srnal,! or large group iiistruction and the 
degree'^of commonaii'^y in pupil experiences. This relation does appear (Table S, 
Figure 3). In fact, tiie tliree classes with the liighest e.stimated i ii r r i cu 1 .i r- 
setting commonaLity (1, 3, anl h) had essentially [lo small *group instruction. 
The variation in this relation is somewhat larger among ^hose clasBes witli 
significant amounts of small group work (2, 5, b, 7, and 8), sir^e such ^Touping 
chies ncjt pree hide homogeneity; it sur.plv allows het er -^gone j tj/ . 

• f*'Kl<.^nt i)t adnil supervision C not ^amngly t elated to eitlier tiie hc>nic»':eue H 
ol 'pupil pt^Tiihcv . o! the use i>t > ma 1 I gKUips. A p|Li r t t y * teaUnr a(rdfs .an 
be and nre used ii av^ tiiat do p(''t aii^i out adult suptrvision. Classes with and 
without aides are uiielv vari.d^Io \i\ .-diUt super \' i 1 nn . 




Percentage Small Group Instruction Tire 

Figure Rtl?. t ion^-'^up Betveen Corrr.onality of Selectivity in Coverage 

ai.d 7i^e Allocated to Snail Group Instruction as a Percentage 
or i'lrect Instruction Tine for Kight Grade 5 Classes* 

* 2'ata, See Tables J 3 
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Time allocation to seatwork, or to any self-paced instruction, was only 
marginally related to other characteristics of student preparation, resources, 
instructional emphasis, and style. Generally, classes that were more individual- 
4-2ed in terms of content and " setting exposure were also heavier users of self- 
paced modes of instruction. This relation admitted great variation, however. 

AllocaLion of time to reading content-categories . Since we perceived that the 
teachers had a more difficult time accounting for "reading-related" instruction 
than for those clas>5room activities which were more directly foe sed, reporting of 

results will be restricted to content categories I througii VI (Table A»J). 

The amount of time devoted to " direct reading instruction" (Table 4) varied 
from about half an hour per week (Class 2) to almos^t an hour and a half (clasTs 3). 
This variation of almost three-to-one implies that emphasis on reading varies 
enormously among fifth grade classrooms. Note also that this differential emphasis 
was not implementeJ to compensate for the widely discrepant levels of prep.iralion 
of these classes. la fact, the two classes with the largest pre-test means (3 
and 4) received the most reading instruction. Even instruction in reading fun- 
damentals (Table A) follows this pattern. Class 3 devoted about 17 minutes per 
day to f/jch basic instruction, almost 20 percent of total direct instruction. 
On the other hand, classes with lower pre-test scores (1 and 2) devoted only 
minimal amounts and percentages of time to fundamentals (one and a half to 2 
minute^ per day). Thug , some cla^:ses spent 12-fQld more instructional t unc on 
fundamentals compared to other classes . 

The pattern of cinphnsis oti direct reading instruction varies with lev(*l oi 
preparation (as noted above) and with resource support. However, since tht^ 
relations do not logically folluw i rom an analysis of pupil needs, it ib likely 
that these curricular (lioices p<irtially derive from differences in school goals 
relating to community background, and ^"rom teacher preferences, uninformed by 
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comparisons with those of other teachers* 

Another set of curricular allocations is that uf curricular time matched to 
the achievement tests (Table 4). A separate correspondence was made (Table A^l) 
because only a limited selection of content areas in reading were tested. 
Allocations to the matched areas varied to a gr^iter extent than tip total 
allocations, and in a different pattern. However, Class 2 as before had the 
smallest matched allocation (18 minutes per day), while class 3 had the great-st 
<57 minutes) ♦ 

Pupil engagement and absenteeism . Pupil engagement was measured by both teacher 
and observer ratings. The overall mean estimated engagement level was similar 
for both assessments (about 65%), but the variability over classes was higher .for 
the teacher-based scores (Table 6). If we insist on consensus between botli 
ratings, they tell us that Classes 2, 3, and 4 contained the most engaged pupils, 
the others (1, 5, 6, 7, arid 8) were lower and more highly variable in their engaf;**- 
ment (Figure 4). Thus, the three classes with the highest pre-test scores were 
also the ones most engaged in learning. 

If we use these engagement assessments to adjust the mean class times for 
content areas which match tested content areas, the general pattern is the same 
as that derived from the unadjusted data (Table 4). The minor exceptions (Classes 
1 anu H) conform if teacher-based rather than observer-based data are used* 
Then, the effective exposure of Class 1 rises (relatively), while LliaL of (^Itiss 
8 falls, resulting in a considerable discrepancy where rough equality held before. 

Absenteeism clearly limits exposure to instruction; it also might be assumed 
to reflect some of the same pupil characteristics that influence engagement. 
However, there is no evidence of this. The highest absence rates are those of 
Classes 2, 6, and 8, while the lowest are for Classes 4 and 3. This pattern 
relates to no known difference in preparation, resources, or strategy, let alone 
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Figure 4: Relationship Between Mean Teacher Ratings of Student Engagement and 
Observer Ratings of Class Engagement* 

Table 6. Dashed line indicates an ideal relationship where one form of 
rating v;ould be a perfect substitute for the other in work conducted*- at 
class levels of aggregation. 
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our measures of engagement. 

Achievement gains . One of the initial assumptions of our investigation was that 
achievement^' gains and their relations to instructional time would inform us about 
the effect of increases in instructional time on learning, and perhaps t?ven about 
the relation of teaching strategy to achievement. These hopes were thwarted. 
The basic problem seems to be that several classes were close to effective ceilings 
on the test, and that all classes' potential (and actual) gains were more strongly 
Influenced by their pre-test levels than by their time allocations. A plot of 
the relation between pre-test and gains (Figure S) reveals a negative regression 
coefficient of about 0.17, with little scatter around the regression line. This 
sLti»ation leaves little hope of detecting a relation between time and learning. 
This relationship is discussed later in this report. 

Class Descriptions 

Class 1 . Generally speaking, the first class is typical in regard to many of 
the characteristics considered here. However, exceptions to this fact related 
to teaching style. The teacher of Class 1 chose to employ only a small propor- 
tion of the potential content x setting areas (67 out of ^44; Table 3). This 
resulted in use of only 33 of the 68 content areas, and four of the eight 
settings (Table A. 4.1, Appendix A). No other teacher reported teaching in ho 
few areas. Furthermore, the instructional approach this teacher ioi lowed was 
probablv nut iuglily selective in its directions and coimiumicat ions to pupils; 
that is, instruction m this class was non-ind ividual ized . Also, during the 
period of the study, this teacher allocated zero time to small group instruction. 
Thus, it appears that the pupils in this class were directed to part iti pate in 
most learning activities as a large group, a result consistent with the lack ul 
individualization in instruction. In addition, only relatively .mia I 1 amounts of 
time were allocated to adult supervised activities and to instruction in tlie 
fundamental areas of ri\adiiig (T<ihle . 
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This teacher had no teacher aide to assist her (Table 4). Thus, it is 
perhaps not surprising to find no emphasis on small group instruction; but 
lack of a teacher aide need not confine instructional strategies to the w hofe- 
group type. Since these pupils were reported to be **dif f icult*' and "inattentive,* 
perhaps their teacher felt that small group instruction could lead to greater 
opportunities for student misbehaviors. Yet the teacher spent relatively little 
time in active supervision of pupils' work. 

The observer's general rating of the class' level of involvement is low 
(Table 6); but this is somewhat at odds with the teachers' perceptions. How- 
ever, owing to the way the measurements were taken and summarized, these 
statistics may well refer to different phenomena; and outright comparisons 
of them could be misleading. 

While the mean posttest score for this class was moderately high (Table 
7), so was the mean pre-test score (Table 2). 

Class 2 . With regard to all measures of initial characteristics. Class 2 
appears to have much in common with the first class. However, this similarity 
does not extend to measures of teacliing strategy (Tables 3 tliruugh 6; Tal)le 
A. 4. 2). Instruction in this class (Table 3) utilized considerably greater 

i 

numbers of content x setting categories than did Class I; tlie instruction 
wa^ .il.so highly individualized (Table 3). This suggests that a iari^u amount 
.U (iirect instruL t ional time was devoted to sm^ill group anc uatworr. settln^'.s 
(Table 5). However, the substantial absenteeism (Table 6) probably re^iulled % 
in instruction which was more individualized than the teacher intended it to l)e. 

Although reading instruction in this class was liiglily ind i v idua 1 i zt'd , 
only small amounts ,)f instruction occurred (Table 4). Pupils in this set ond 
class received onlv about 11 hours of instruction in reading and read i ng-re la t ( d 
areas over the entir(^ time of our student (about {)./ iiours per d<iy). 11iere 
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were an estimated 230 hours during which the students could have been instructed 
in reading (T^jble 4) These pupils could have received the greatest amount of 
reading instruction of all students in the study; they actually received the least. 

Time allocations to direct reading instruction and reading instruction in 
basic, tested content areas parallel those of reading and reading-related in- 
struction. Since relatively little' of the direct reading instruction time was 
allocated to instruction in reading fundamentals (Table 5), this teacliers' 
apparent de-emphasis of reading instruction might not be severe in its effects 
on achievement; we might assume that the children had already adequately learned 
the reading fundamentals. 

According to both teacher and observer ratings (Table 6), these students 
were highly involved in their work, thus making better use of time given to 
acquisition of reading skills than their counterparts in other classes. HoWfever, 
as mentioned above, the pupils of Class 2 had little opportunity time to advance 
their reading skills. In spite of this, the average score on th'j posttest and 
the average simple gain score were moderately high. 

Class 3 . At tiie outset of the study, pupils in the third class possessed more 
highly developed reading skills than most of the others (Table 2). Fur tliermore , 
the instruction they received during the study was unlike that of the otlier 
classes in many ways. For example, the pupils were exposed to a large numl)er 
of content X setting combinations, but tiie instruct ion -appeared to he lausL oiteii 
of the whole-group type (Table 3 and 5). i pils in this class were uxposod to 
more content areas than those in any other (Table A. 4. 3); and on tho average, * 
this teacher alioacted more time to Instruction in reading than did tlw otner 
teachers (Table 4). Since no teacher aide helped in this class, it is appai ent 
that the teacher supervised most of the leariiing activities iierseJt (Tai)le ')) . 
Furrlierc^ore, relatively little of the instructional time was spent with pupils 
worMng 1 ndependeiiL I V at ttu-ir se<its (Table ')) . 
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Both teacher and e^jternal observer ratings of pupil engagement for bli is 
class were high (Table 6), In addition, a great amount of time was allocated to 
reading. It therefore follows that the indices of "effective reading study time" 
should be high, and they are (Table 6). However, the low simple gain and rate of 
gain figures (Table 7) seem to indicate that these students profited little fro.n 
their extensive e::posure to reading instruction. It should be noted that these 
figures may be misleading because of test ceiling effects. 

Class 4 . The fourth class is outstanding for its members* high levels of initial 
reading achievement. The mean composite score on the pre-test was 250 out 
of a possible maximum of 284 (Table 2), Instruction was not individualized 
(Table 3). The number of setting x content :ireas covered was typical of tlie classes 
investigated -(Table 3 and A. 4, 4); but over 90 percent of those combinations were 
used for all the pupils in the class and this was atypical • As in Class 3, a 
strong emphasis was placed on instruction in reading. .This emphasis is indicated 
by the higl) time allocation (Table 4). Ic is clear from Tablu 5 that this teaclier 
and that of Class 3 used -dif f erent instructional settings to similar extents, 
(A siiglit exception is the relative amounts of indpendent scatwork, which wa 
granted more time in Class 4.) 

Both teacher and external observer ' indicated that the students were liighly 
. involved in study (Table 6). Consequently, the estimates of "eftective study 
^t ime*' art' hi gli . 

While the mean posttest scor- for this class was ' ery high, the average gain 
and gain rate figures were ratlier low. Again, the latter results are probably 
attributable to test (.eilkig ef£ect^. 

Class b. Instruction in Class 5 was varied in cpVerag^ Cispecially in terms ol 
I 

copr-'nt, but was lmiIv mudt^rately individualized (Table 3). Kifty-^four content 
areas were covered; the majority of tliese were taught via two or more statings 
(Talkie A. 4. 5), Althuugii ^el.itivelv little di-.-ct rtM<iing instruction lime was 
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ailociated to adult supervised instruction, a compara t ively lar^ .unouiU ni this 
time was given to instruction in the fundanentals (TabU' 5). 

The average teacher rating of student involvement in stuc y wjs low, as was 
^ "stimat^d average "effective study time" based on this rating Clable 0). 
DespxLe this, howev the average gain and rate of gain figures for reading 
achievement in this t'lass are rather high^ (Table 7). 

C lass 6 . Class 6 stands out because its mean cor\jpobite score on prc-Lt'sL was 
extremely lew v'^^^ble 2). While the number of content areas cove'"*'d in thi* class 
Wc»s typical of the ethers (Tables 3 and A . 4 . 6) , * i r a ppea rs that llie instrucLion 
was relatively varied in terms of concent- x setting area utili^a*»on, <hk1 fairly 
individualized and differentiated (Table J). Absolute liinv. a]]oc<itions Lo various 
reading areas were not extreme (Table 4). Most of the dircLt reading, instrui^lioii 
was delivered in adult-supervised inde^ondenl-seatwork settings (I\d)li S) . 
Absenteeism posed a problem for Lliis class (Table 6), And altiiough thu nuwu 
composite posLtest score for this lIiss was lower tiian that of any oth^r, the 
averak;e gain and rate of gain statistics were the highest (Table 7). 

Class 7 , Concerning commonality in coverage (Table 3), it appears Lh.it tlu' ir 
struction in Liie seventh class was highly individualized, altliougli « oiiLent 
ivWt-rage wa.-. more typi»^ai (Table A. 4. 7). However, in some t.ases Lhu Lt.M( }.< ' 
iiiicd tu viord Liuie spent in the reading-related area^-. taught l)v I h^' v^Unh-- 
cia-s nu'thod. Therefore, the available i iguros ClVibli' 3) may indicate th<*t iu- 
ntruction was riore individualized and differentiated th<in it rt^ally was. 

A revit^v/ of Tah'tj 4 stiows that little time was alloLatcd to Mrrit reading 
lastruLtion and to i ns t r Ui. t ioii , [.^e b<isic, tested couLoiit aroas. Mus* direct^ 
reidin^. instrtution th.it v^;as Londu».ted used sm<il I r(H>j^ settings {'Lihh ; this 
u'uKuihted 1 Y promoted by the ( onstant availability of a toathi-t a uh (Tablo ^* ) . 
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Both teacher and external observer ratings of .student engagement in study 

were low. As a consequence of both this and the low time allocation to reading 

f • 

instructipf* . estimates of "effective study rime" were also low (Table 6). h >th 
the mean composite pre- and post test scores were moderately low as well '(Tables 
2 and 7). 

Olasi^ 8 . Instructional coverage in reading was not highly varied in ^le eighth 
cla^, .Table J). Qriiy a moderate number of content areas were covered, and most of 
these were taught in only a few settings (Table A. 4. 8). However, thv instruct ioi. 
was basiucilLy individualized (Table 3). Pupils in this class most likely received 
less overal 1 instruc"^ ^ o!i than pupils in other classes (213 hours; TaUj L^ ^) « 
But instruction in the reading areas 1.54 ho^^rs pei day) was not sliglited to any 
great extent because of this. Direct instructon ^'n reading was typically given 
ill the form of independent seatwork (Tab- ^ 5) * 

The mean teacher rating of student Involvement in (^udy (Table 6) was quite* 
low. However, partly because an extensive amount of time was given to instruction 
ill reading, this low student engagement did not yield excessively low ^V'ffectivi' 
t>tudy time." Therefore, we would expect mean composite post test and gam scores 
tu have been liigtitir f.han in fact they were (Table 7). Actual celling eMccLs 
cannot explain tliis. 

Allocated Instruc t ional Time and Achievement 

Ordinarily, in studies of this kind, relations between measured character- 
istics are invcsL*1^4.4.ed by regression analysis. Sue h atiaJ yses , in tlie simj)lost 
sen- . ap^^rox imate relations by means of a straight line. Th.is, only two ( liar- 
aiteristiLS )i the approximating line need be calculated to assess the rti.it ion: 
tiic^^evel of tuiti^i)i; (in tiiis .ase, *u h i evijiu -nt i^ciin) corresponding', to /.t-ro on 
the «'xpldr itory l harac t er ib t ic (m thi'^ case, time); <inJ ^i)e ajrount ul ( li.in)'.e m 
outtome i orrespcHid inr, to .i vMi-uij oj one unit (iiMiuite or hour) m the oMu r 
i fi'.i f at ter 1 It . 
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In some Cciseia, liowevt^r, more constraints cun be imposed becaubtj ul tlie 
character of ti\o variables studii^d. For cx_^mplc, in our application, the ioliow- 
mg are possible spec it ications: 

a. " true gams bhould always be positive or zero, i.e., negative 

observed sl( aifferences arc attributable to measurement 

*». 

e t t o r ; 

b. zero ins truc' t Lonal time should lead to no achievement gams; 

i.. . the iMoic I inie spent Learning test-related content', tlie Larimer 
the ^^aia m rested achievement; or ut the minimum, true 
ne^^itive reiation^. are impossible. 

If wc ai cept these spec if n lat ions (or at least the first two) as reasunahU", we 
can implement trcui^er methods oi estimating relations between time and achieve- 
ment. This can be done because ti^e line which we use to ap[)roximatc the relation 
must pass througn the origin, i.e., the intercept (tlie gain eor respomli ng to 
zero time) is .-^ero. This implies tha there are several ways ^t" estimating the 
reiatitjn (i.e., the .^lope) . Three interesting pos s i In L i t ies are: 

a. aViM-igmg tiie ratios of gain to t imj for individuals in a group; 

I. avtra.;ipg the gams for a group and dividing by tiie averu^-.e time; and 

I . [>er t .u -uiu; an ordinary r tigress ion. 
The fir^t tui al-i) [\ave tht^se advantages: they will likely result in pos i * ve 
estimates, s mc e the average gain will lil-ely alwavs be positive tor t.Mt ii grouj); 
and Lhey arc net as seriauslv at fee ted by measurement errors in the time .jssess- 
ments (i.e., t..cv lit not atteiiu.ited ) to as gri-at a dej.^ *'e as ortlin.iry re^-.n-ss i on . 
We iiave i "crU ed t'u-.." procedures i t h the- tifth gr<td. reading d.ita m threi' 
area^,: dei. 'iJij^i ^ ^-nt ul t lu es; and lin.^ rnot wtu'f! and p,ir t -separ i t mu »s(.iles 
if \ word St ru(^ t ur» . 
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The results using the first two procedures for the three content aruds, 



using the median ls a robust averaging method are reported in Tables 8, 9, and 10. 



Generally, thest results are consistent between the various estimation meiliod,., 
although they display considerable variability over classes. The cciliuj/ effecis 
described earlier are apparent here as well, the smallest gains corresponding 
to the highest pre-test levels. 

The regression' analyses are reported in Table 11. A diffrrent tack was 
taken here, since itandard programs with greater flexibility were available. 
We first tested to see if the relations between time and gain were homogenegus 

over classes. Aft^^ir finding no evidence of heterogeneity we estimated the common 

1 

regression slope by pooling the data. Here, we found no statistically significant 
relauloiis, although the confidence intervals for the slopes were consisLent with 
Llie results of the other two analyses based on the more stringent assumptions. 
Til fact, allowing for the ceiling effect problem and the attenuation of the 
regression estimated slopes resulting from errors in the time data, th<* r* -;ults 
were gratifying in their consistency. Finally, we tested to see if there was 
any evidence to suggest that classes were different in their gains wfien aLlocati•^] 
time wJr. fi'ed. There was no such evidence (Table 11). 

The fnajer conclusion we draw from these analyses is that eejJ_iau;_ ef fi-e ts 
^^^'J sampling variations have resuL^.ed in difficulties for the detection uT 
^ m s Lt>t en_t rrlitirns wliich are a b^u prec ise enouwji tt' useful. Tli*- results 
thenKselvt\s H't' i^onsKstenL over estimation [)roLedures, and are compatible willi 
•^.uhstant ive i nL pr La t uuis ot po Aiv(^ and potentially [)Oweriul relations l)iawet*n 
t ntie and 1 imf n in^; # 

KnKa>;eruent , Fn^ a ^ed TLae, and At hi t-^veiniMit ^'ain 

An irnport<int ci)nit'ptu<il issue in the anaivsJs of ilata on nn>tru( L iun.j I t niu-, 

cspeiiallv as it relates to at h i cvemunt , is the engagenaiit or invol vi^ncnl (>! pupilit. 

It scfius likflv tluit i)('st i*eo 1 learninr i>< i urs durin/ perioas when the pupils 
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Table 8 

Achievement Gains and Allocated Instructional Tin'e: Decoding 
' Medians 

Time - 

C lass N (hour s) Fre-test Post-cest Gain Gain/Time Med . (gain) /Med . (time) 

% Raw % Faw 



9 2.53 93.8 40/ 3 93.8 40.33 0 .000 ' 0.00 

16 1.4? 93.8 40.33 93.8 40.33 0 .000 0.00 

16 1.^2 63.2 27.16 31.66 2 1.83 1.38 

15 U.53 35.6 15.32 16.00 ^.32 18.90 17.46 

4 1.08 52.7 22.67 28.33 3 4.32 2.76 
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Table 9 

Acnievement Gains and Allocated Instructional Time: Context Clues 

V 

Med ians 

iirae 

Class N (hours) Pre-test Post-test Gain Gain / Time Med . (gain) /Med . (time) 

% Raw 2 Raw 

1 22 0.52 76.6 24.50 86.4 27.66 ^ 1.34 2.52 2.59 

2 9 U.78 o7.2 21.50 78.1 25.00 3.16 6.30 4.03 

3 9 2.23 87.0 27.83 91.7 29.33 1.50 0.66 0.67 

4 16 3.02 93.5 29.91 91.1 29.16 -0.08 0 -0.02 

5 16 2.35 54.7 17.50 62.8 20.08 2.75 1.08 1.17 

6 15 0.58 14.1 4.50 18.7 6.00 1.68 2.52 2.88 

7 9 0.77 56.7 ]3.16 52.6 16.83 0.35 0.42 0.46 

8 8 l.h 42.4 13.58 46.1 14.75 1.17 0.96 0.62 
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Table 10 

Achievement Gains ahd Allocated Instructional Time: Word Structure 



Medians 

Class N (hours) Pre-test Post-test Gain Gain/Time Med. (ga^,n)/Med. (time) 

% Raw % Raw 

X 

2 8 0.43 89. A 23.25 92.3 2A.00 0,75 1.71 1.73 

3 9 4.18 89.7 23.^3 94.8 24.66 1.33 0.30 0,32 

4 16 0.90 94.8 24.66 94.8 24.66 0 0 0 

5 10 0.70 78.5 20.42 86.8 22.58 2.00 2.61 2.86 

6 15 0.97 42.3 11.00 64.1 ib.c6 1.82 1.86 1.88 

7 9 1.18 74. 19.33 75.0 19.50 1.33 0.96 1.12 

8 14 2.55 86.8 22.58 89.1 2^.16 ^ 1.34 0.75 0.53 
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Table U 

Parellelism, Regression and Covarlance Analyses of 
Instructional Time and Achievement Gains 



Skill Area 



Summary Statistic 
1. Parallelism Test 



Decoding 



Context Clues 



F 
df 
P 



0.04 
4/50 
.82 



1.10 
7/88 
.37 



2. Regression Analysis 

coefficient 
standard error 
t 

le 

R 

F 

df 
P 



-.474(-3.27,2.32) 

1.338 

-.0464 

.0005 

.0233 

.03 
1/54 

.86 



-1.704(-4.33, .92) 

1.314 
-1.2983 
.0174 
.1320 
1.69 
1/95 
,20 



Test of Di ff erences 
in Rate of Gain ,"'v er 
CI asses 



r 
df 
P 



2.42 
5/54 
.06 



0.74 
7/95 
.64 
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Table 12 

Relation Between Teacher Ratings of Engagement - Total Pupils 



No Adult 

Present Adult Present 
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1 


5 


5 


1 




12 


6 










1 


3 


9 


6 




19 


7 














12 


21 


A 


37 


8 














1 


16 


10 


27 


9 


















19 


12 




0 


3 


A 


7 


7 


20 


30 


A5 


27 


1A2 



Median AP - 7.54 
Medli^n NAP - 6.6^* 
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Table 13 

Relation Between Teachei Ratings of Engagement - Class b 



No Adult 
Present 



Adult Present 







1 


•* 


3 


4 


5 


6 


7 


8 


\9 

. 




























1 




















\ 




2 










1 












1 


3 






















0 


4 










2 




2 


1 






5 


5 














1 








1 


6 
















4 


1 




5 


7 
















1 


4 


3 


8 


8 




















2 


2 


9 






















0 




0 


0 


& 


3 


0 


3 


6 




5 


22 
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are attiintive to learning activititis; consequently, if appropriate adjustment's 
of allocated time are made to take differential atterttf\ieness of pupils into 
account, stronger relations with acliievement should emerge. This concept pro- 
vides the rationale tur analyses involving the judged engagement raten of tiie 
pu p i 1 s . 

Two primary issues regarding engagement data are re liability and valid Lty. 
The only available dat.i on validity (presented earlier) siiowed that moderate 
agreement existed between the class means of the teaci. - and observer ratings. 

Table 12 presents the relation between two teacher ratings of pupils general 
levels of en:agemert: with and without adults present (Table 13 presents 
analogous information within a specific class). These assessments are highly 
related; but this is probably misleading, because few kinds of components 
(t^.g., ti-u rating or time of engagement of rating error) enter into dis- 
crepancies between these ratings. 

rhe change in the relation between time and achievement after adjustment 
tor 'ngigement was explored. In at least oric ot the classes (Class 6), the 
correction did not strengthen the relationship. In faet, the rela t ionsfi i p 
between tjTe a^^d 1-arning was weakened. tlowever, this re ilt should not be over 
interpreted since data were available for only 1 students from Class b. 
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^ "Maximal puNSil)le exposure to instruction'* was Lakiilated by tindiiig tlit 
j.noant ol t i ^e a student could be in hisMiei lKi^s (Mi anv given day and 
multiplying this amount, by 40 da>s. 



2^M..n number of ab.onL davs" was calculated by dividing the nppropr.ato 

,r:::;^>;'\.::.a,;.r;,; "lb.. .\ 0^,,,....) .bi.d.... ...... 

bv .... .u..i...r ot u.lluw.J Unldrcn an.l nuU,,lyn>, by lon. 

S -n,/,.,s, ..f t tw. .al.u!.L...l bv tanuK iw.. t . a. h.-r ra t h.,s 1 

,,,t-'^ uw.>iv..,.U. tr.nsuu.u.:.., .a, b bv Lb. 1 tb.. lon„..la I H 

( . .) (wb.r. K run,; ..s...nc-d bv tb. L.a.b.r). av.aaK.nK t b... 

cua..nts in tb- la... ilus ,a.....dnro d , s L . . bu t lb.. taL.n,. 



or 



(iver a: 



h, I w,.en 0 and 1^0 ptT.vnt . > 
in their ^ urr ent invvA (S» e ! 



the s^ < ond v li i ible were ^;iven i o 
, Appt ud Ix A ^ . 



I V 

n s 



The first and third of these variables, '*mean ove ill teaclier-ust imated 
effective reading study time** and 'Wan overall t er-^stimatod efl-ectivc 
study time for pupils in basic tested reading cot areas/* were lmIcuI itcd 

by multiplying the average transformed teacher rac..; (.f each .'ipil by th.e 
teacher's actual time allocatioui (for reading and reading-relateu , and basi^. 
tested, content area instructions; to that pupil, and then calculating tht> 
class average of these products. VaVaes for the other variables, **observer 
estimated overall erfective reading study time" and ^'observer estimated 
overall effective reading study time for class in basic tested cont^'nt areas," 
were derived by simply multiplying the observer's estimate of the percjui >.;e 
of pupils involved in learninp, by the mean time allocation figures. 

This rate was calculated by dividing the average gain score by the aven'ge 
amount of Instructional time the teacher allocated to the curricular artan 
inci uded . 
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IV. SlIMMARY ^ 

Aliocatii>n of ins t rue t lonn linw m rL\uiiiu; wds exdmiiied in liitij 
grade ciassus. Ttic niajv-r purpose oL the work was Lo eniLgiiten the dL'si^^n and 
conduct of Phase Ill-B of IM'ES. The cLasbes were reinarka!)ly diiieretil in a 
number of i^.portanl ways. Differeuees in breadtli of (.ontent covera^'/', as 
retUcti'd t>y tiie numht-r of specific cout^'Ut categories taught, were ^',ri'aL, 
In addition, the kinds jf sL-ttings errpioyed in tiie classrooms <iiid the rx- 
posuri' ot students in the saua class to a variety of settings were dittere.it. 
When uiiteLLnces in ^t>ntent and setting exposure aic comhiiied willi wide 
dilferM..»^s in amoai Ls of time alloiated to the content-setting co'iiln uat i oiis , 

It was ^ieat that the upportuixi ty-to-learn for students varied gieatly t rtvii , 
once cias^ to anotaer. I. wa^ aiso_ found thai opportunity-to-j earn w<is (juit" 
diffc 4Ke tr^'i student to student with ui any givea class. In tlie latter 
case, diffeiential studenL .absentt ^ ism appeared to havc-^an effect, Seveial 

indicators v.f Hid w idua.l 1 zat Lon of instruction, ca^t in ternis oi ellotat'-d 

t iPiL pattt-ris, wer • -ugge.-ted. 

Mc' III teat her ratni//- i»f student engagement conipar cbd* reason<ih ] y well vath 

nuu':)tauh'iit Iv .>i).sirved eiass uverai^^s ol engagement. Ik)wever, thes<> data did 

I, • ..[lovv ^u.parL-.i'n at tae mdividaal leve.' s i m e observer d..t<i en iiui 'doa 

.tndt'pt .Lit' lu't av'a i lai^l l . 

I.,, n ,1 - >i ille ated t nat and av h levein-i.t wer^ louded hv ^ivti'- 
,iia.. -tl-iL.. :i..'rai .>v)^.^.ibli .t r iti'iM s uial-si'^ were ■ .a j'.i',t's t . u I 

but Lee re.'It^. ui't... ! vilM - a -;et wer.*-'""U ear 1 \ alKcted I'V the 

t< st L t 1 1 i !1 , 

',t_ti*in'.' i; 11 ii t ue it ,;rcidr ') aas -,u"ie i ih'R i <.'iU c I la r a^ ( e t i s Mm ^ v'jMih 
u I n ir . . i. ( ii > 1 .OMfwii J I a i 1 t M u 1 t . Pu' ( oiU • [it t>t rrad Miv at t h 1 

i , V. i I <|M i tt «. t ' ! lu (Ml . f >r I !u « MP= laiiK'tii a 1 sl^ ; 1 1 > t i . ed 1 m 

i ) ^ 
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r ading have been acquired, (Certainlv the students tested very well in the 
"fundamentals/') Wliether or not these skills iiave "come together" to produce 
mature readers is another question. By grade 5, instruction in reading begins 
to center on compreliens ion , synthesis, and evaluation and achievenient in these 
areas does not seem to have single or linearly related sources. Influences 
outside school as well as school instruction may be expected to have a relatively 
large, impact in these areas. 

In spite of these d 1 1 f icult iej? the current study provided a number of 
insightful t l).irac ter tzations of leading instruction. It is clear that patterns 
of t inrc alK>Ccition tn content-setting combinations vary both withiii and between 
classes and triat thest- d' ^eren. es may have important implications lor stu<lent 
learning;. 
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Table A.l. Correspondences Among Reading Subtests and Elemp^tal Content Areas 



Content Area 



Sub-Test 



Content Area 



Sub-Test 



Decoding 



Context Clues 



Word Structure 



3 

4+5+9 
8 

>+4+5+8+9 

16 
17 
19 

16+17+19 

22+23+24 
26 

22+23+24+26 



Word Meani. 



28 

n 

32 
33 
34 

28+31+32+33+34 



5R1 
5R2 
5R3 
5R4 

5R5 
5R6 
5R7 
5R8 

5R9+5R10 

5R11+5R12+5R13 

5R14 



5R15 
5R19 
5R17 
5R18 
5R20 
5R21 



Comprehension 



36 
37 
38 
39 
40 
41 
42 
43 
44 

36 through 44 



Application 



46 
49 
50 
51 
52 
53 

46+51+52+53 
46+4i# through 53 



5R26 
5R27 
5R28 
5R29 
5R22 
5R23 
5R24 
5R25 
5R30 

5R26 through 5R30 
or 

5R:2 through 5R25 
plus 5R30 

5R32C + 5R32d 

5R34 

5R33 

5R32b 

5R32a 

5R32e 

5R32a through 5R32e 
5R32a through 5R32e 
+5R33+5R34 



erJc 



> 
I 



74 
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Table A. 2 





Estimates 


of Average Class 
Grade 5 Reading 


engagement 




Class ID 
Numher 


Average Number 
of Students 
Observed 


Number of 
Time Samples 


Time Sample 

Interval 
(minutes) 


Averi^',i' 
KiiKJKeinent* 


01 


19 


42 


5 


.r/ 


02 


IJ 


14 


4 


.V) 


' 03 


9 


54 


4 


J(y 


04 


IH 


49 


4 


.74 


05 


13 


46 


4 


.05 


10 


21 


26 


4 


.73 


12 


21 


11 


4 


.57 


1') 


17 


47 


4 


.hh 



ThcHv "JsLimaLes wore calculated from one day of observation per < lass. 
In all cases data were coilecLed during class Lime which was allocated 
to reading aLLiviLies. Since teachers allocate varyi'^<; amounts ol t -mi' 
to reading, the time period covered hy the ohsecvation differs rnnsider- 
ably. The observers counted the number of students engaged at four minute 
intervals (with one exception) and recorded the number of students engaged, 
the time, and the number of students in the classroom who were part ol the 
blhS study and who were nominally working on reading activities. The 
average engagement was calculated by sun ^ing the number ot students en- 
ga);ed over the ti>tai number of time samples and dividing by the sum ol 
the numbtr i)t students in the classroom biding followed by BTKS and 
noriin^liv working ua reading activities. No distinctions havr bren inadtf 
bet/;een -.uhareas of content within residing or setting comb i-na L i ons . 
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Table A. 3 



List of Skills for Reading 
Grades 2 and 3 



!• DECODING (Letter sound correspondence) 



1. Single consonants 

2. Consonant blends and digraphs 

3. Variant consonants (c , g) 

4. Vowels - short 

5. Vowels - final "e" pattern - long vowels 
h. Vowels - digraphs 

7. Vowels - dipthongs 

8. Vowels - vowels -I- r (car) 
Complex, uulti-s> liable 

10, Silent letters 

11. Sound substitution tasks 
\2, Sight words 

13. Automat icily of word recognition 

14. Other 



II. (.ONThXT CLUt:S :Fill blanks, predict) 



Choosing word(s) which fit grammatical context 

lb. Cliuosing word(s) which make best oense (semantic appropriateness) 

17, Ciicosing correct form of word 

16, Choosing word with correct initial consonant 

19. Chfosing correct pronoun 

20. Other 

III. WORO STRUCTURE 

21. Coiitpound Words 

22. Idiiitif ication of root words 
2 5. Prefixes - mtfaniig and us,^ 
24. Stiffixes - meaning and Ur,e 
2^. r.outract ijiis 

2o . Sv ' i al) I e^ 
2. . ot'i cr 

IV. WORD Mh\NrNG 



28. Synonym:, 

2V. Autonyms 

iO. Vucahulary building 

j] . f'ro!U3un rt'fercnce 

32. Mu It i-mtMH 1 (li; w(>rds in lontext" 

n. l'n.fain I 1 lar wotds in contt'xt 

ia . F if^iiv U iV" 1 a 11/ uai;e 
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Table A.J (continued) 



V. COMPREHENSION - Text 



36. 


Understanding event detail 




37. 


understanding description 




38. 


Understanding relat ionshipi' 




39. 


Understanding main idea 




40. 


Literal recall 




41. 


Translation of ideas 




42. 


Synthesis of ideas, inference 




43. 


Going beyond the text, prediction 




44. 


Recognizing facts and opinions 






General comprehension 




APPI.ICATION 




4b. 


Understanding directions 




47. 


Picture interpretation to aid compreliension 




AH. 


Dictionary skills 




49. 


Reference sources in books (table of contents, index. 


glossary) 




Choosing reference sources (dictionary, encyclopedia. 


card c*<i tal 


"^i . 


Understanding signs 




52. 


Understanding letters 




53. 


Understanding maps 




54.^ 


Understanding graphs 




55. 


Reading for different purposes 




5b. 


Oral reading 




57. 


Reading for enjoyment 




o2. 


Silent reading 




Kl'ADlNC; kKIAIKl^ 






S|)(.' 1 1 1 ng 






(Iramnia r 






(,rfaL 1 ve wr i t ing 




f)] . 


HiMding in Lonteiit areas 




hi. 


1 i'^teiuiif; (to ^^tury ur tapes) 




*A . 


I\Miiiiansli i p and copying 






St .1 nda rd I /ed tests 




f . 


F <>re ign i an)j;ii i;;e 




b/ . 


MubU (reading lyrics) 




b8 . 


Drafnati(. s (plays, choral reading; 





Table A. 4*1 Class 1, Settings by Content Areas in Reading 



Con' int Areas 



1i 



34 5^ HI,M1 Mt,47 50 



5t 58 4^ 



C 



30,31 



HO 



M7,H« 50 
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Class 1 



No. 

of 

Settings 



% 

7 

S 

Mi 

5 

1 

V 



1 


.0303 


q 


■ nil 


13 




10 - 





H Frequency of Content Area Use 



> 

t 



Table A. 4. 2 Class 2, Settings by Content Areas In Reading 



Content ^^ea 



ft 


7 








5t,S7 


w 




5 


3031 35 


3^37.31 3^ ,M'i,'«4,«i5 








H It U 




3t 34,31, HO HI.H3 H5 


50 5S,5t 


51 ;i 




3 


30 


3H it J? no 4H Mt 


'I'l.SO ss.sw 






a 16 








6i 





Class 2 



81 



f 

No. ^ 

of 

Setting!^ 



s ■ 


H 








.1707 


i ■ 


« 


,mt3 


1 ■ 


IS 




1 • 


10 






HI 


Frequenc 



! 



B'. 



Table A. 4. 3 Class 3, Settings by Content Area s in Reading 



Content Area 



55 F7,Sij,54.tO,U fc^,( 
■J5 '<> 
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set t ip<^5^ 



« 

7 

s 

3 



^1 

8 

55 



t - ^ ^ 

Frequencv of Content Ares Use 



84 



Table A.-.^ Cla^ss Settings by Content Are^s in Reading 



8 

-.7 



30 



C o n t e n_t __4re.a 

38,31 Hl.s^.MS.Ht qg.^Hi'io ^ 57 



•<5 4lj 



53 Sfl bt 
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S e r 1 1 n p. 1= 



1 ^ 

b 

5 - 

3 

X 



5 


mi 






15 






,7-11 1 


H5, 


Free uer.r 



c n t: t n l .\ r e a I 3 e 



Tiimr^^lali !). UtUngs by UonUnfc Areas In Reading- 



Ccitent Area 



Mi H(» - 5t SI W 



■ ao 
c 



Ij H(i <>o W 



fc,7 • 5«,S1>e 



No. 

of 

Settings 
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f - 



3 
M 

5** 



>C7H| 
.IS 07 

Frequency of Content Area Use 



> 

! 



Table A. 4. 6 Class 6. Settings by Content Areas In Reading 



_ _ Content Ar ea 



7 31. 3« ({0 t3 



3^ S5 53 57 ^-^^(,1^ 



a 5 • . 

c • _ 

? H l.l.M.S Il,l5,lt 11,13,1^,11.^^ 3U 33,3'<,qo,HI MS, H<.,M7.M1 ,51,53 5^,57.56 (dO.t'.U.U CTT 

1 . It 37 3^,40 M« 55,5'» SS.S'J.to 5»1 

■ < II 2(* 37 3«1 M« 5S,wO fcl 
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No, 
of 

Se 1 1: ings 



i 

M 
M 

M 



MO 



.0250 

Freauencv of Content Area Use 



> 

I 



Table A.A_7 Class 7. Settings by Content Areas In Reading 



8 
7 



b 1 



J) 



Content Area 



IS 



31, ?3 St 



5S 



i3 



?f Ml, HI ,43 MS 5t,58,SH •'il»^ 



51 



13,14 U,?o,3i. J7 3^ H} H5.H7,m,4S 55,51., 58 U.W 




Hi 



No. 

of 

Settings 



t 






2 






H 






to 


.ZI73 




11 


?7T7 


> 
1 


IH 


.3in 






Frequency of Content Area Use 





Concent Area 



7 

50,53,%,57,5« tl 



9! 

c 



5 3 fe,7 



I \0 1H,1(. 30 13 17 3<l 41 MS Mt 5fc (.1 











No. 


7 ' 






of 








beltings 












H 


^^^^ 








.1173 




1- 


\x 


.17X1 








Freque 
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Table A. 5 Data Concerning Achievement Cain, Engaged Time, and Allocated Time 
for Class 6 - Decoding 



(Ave Eng. x Area Time) 
Effective Area 



Student 


Eng . A 


Eng. B 


Ave En^. 


Area Time 


bam 


oLuay iiTTie 


181 




D 


t; t; t; 
. J J J J 


/D 


Q 




184 


8 


9 


.8888 


32 


5.00 


28.44 


185 


/ 


7 


. 7222 


38 


12.00 


27.44 


190 


4 


7 


.5555 


32 


12.33 


17.78 


192 


7 


3 


. 7778 


32 


5.33 


24.39 


195 


4 


4 


.3888 


30 


-■1.67 


11.66 


196 


4 


6 


.5000 


38 


15.00 


19.00 


198 


2 


4 


.2777 


38 


8.00 


10.55 


199 


7 


3 


. 7778 


26 


13.33 


20.22 


201 


6 


8 


. 7222 


38 


14.67 


27. A4 


202 


6 


7 


.6666 


32 


1.34 


21. J3 


203 


6 


7 


.6666 


32 


•-1.66 


21.33 


204 


6 


-T 
/ 


. 6666 


22 


10.00 


14.67 


205 


4 


4 


.3888 


28 


■2.66 


10.89 


208 


7 


9 


.8333 


24 


9.M 


20.00 



*Eng is an abbrfviation for Engagement < 
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Table B,l 



Elertental Content Areas Involved in Various Aggregate Content Categories 











































VJ 
























(I) 






<y 








J-* 




























0 












<j 




u 






1— 


•H 




4^ 


0) 








00 










u 


! 


c 


H 




00 


u 


c 
















4^ 




C 


•H 


X 








u 


C <U 


6 


- c 




c 


Q) 


T3 








u 


•H 


'H 4-» 


n3 


6 0) 


o 


•H 




0 






T3 






•O 03 




'H 4-» 




T3 


C 


O 


c 




U 


£ 


a 


03 »-H 


C 


W C 


u 


03 


0 




0 


0 


o 




a. 


O Q) 




03 0 


•H 


0) 








— — 






< 



















0) 
















00 








u 




c 












c 








0 


oo 


0 














o 






u 


c 


•H 


c 




»H 


4^ 












o 


•H 




0 




03 


(0 




tj 


< 






D 


c 


C 


•H 




4^ 


0} 








00 




u 


03 


Q) 


4-> 


1 


C 


H 








c 


4-> 


iJ 






03 


oo TJ 


0) 




4J 




c 




X 




£ 


Q) 


O 


C <D 


B 




c 


u 












U 


•H 






o 




u 




0 










iH 


13 03 




•H 


4^ 


<u 


c 


o 


c 






6 


a 


03 


C 




c 




0 




0 


0 


0 


o 


a 


Q) 0) 






0 


•H 










;^ 


V 















97 



1 


X 








X 




X 


35 


X 








Z 


X 








X 




X 


36 




X 






Q 


X 








X 


X 


X 


37 




X 








X 








X 


X 


X 


38 




X 








X 








X 


X 


X 


39 




X 






D 


X 








t 

X 




X 


40 




X 






/ 


X 








X 




X 


41 




X 






Q 
O 


X 








X 


X 


X 


42 




X 






Q 


X 








X 


X 


X 


43 




X 






1 n 


X 








X 




X 


44 




X 






1 1 

Xi. 


X 








X 




X 


45 




X 






1 7 
XZ 


X 








X 




X 


46 






X 




1 '3 


X 








X 




X 


47 
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Table U.2 



Number and Percentage of Teachers Using Lach , 
)er Coritent Area - Setting Combinations 
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Table B.3 

Reading Related Time 
Percent Allocation by Content Category 

Total Time 



Class (minutes) General Content Categories 

1 2 3 A 5 6 1 ' 

1 4284 .36 0.0 0.9 0.8 1.5 15.2 30.2 51.4 

2 1602.36 0.0 1.6 2.0 16.5 26.6 33.9 20.1 

3 5362.00 4.3 3.2 5.0 8.8 25.0 18.9 34.8 

4 5209.27 1.8 3.4 2.5 7.3 21.9 29.2 33.8 

5 3566.50 7.6 5.2 1.3 3.6 12.6 16.8 52.9 

6 3554.36 2.4 2.3 8.4 2.9 12.3 29.2 42.5 

7 2288.04 4.4 3.7 4.3 9.6 19.7 17.5 40.7 
3 3b82.98 2.5 ' 2.2 6.3 7.0 12.1 50.2 19.8 



Table p. 4 

Direct Instruction in Reading 
(Excluding Support Activities) 

Total Time 



Class (minutes) CeneraJ Cortent Categories 

1 2 J 4 5 6 

1 2080.52 0.0 1.8 1.7 3.0 31.4 62.1 

2 1282.94 0.0 2.0 2.5 20.6 33.3 42.4 

3 3496.20 6.6 5.0 7.6 1 3.5 38.4 29.0 

4 3447.55 2.7 5.2 i.8 ll.l WA) 44.2 

5 I o8 0 . 3 1 1 6 . 2 11.0 2.9 7.6 2 6 . H . 6 

6 2044.72 4.1 4.0 14/7 5.0 21.4 50.8 

7 1355.78 7.4 6.3 7.3 16.2 33.2 29.5 

8 295^.86 3.1 2.7 7.8 8.8 15.1 62.5 



1 U'/ 



lJ-4 



Table B.5 

Time Allocations (in Minutes) to 
General Content Categories 



(j]^ass Content Categories 



1 2 3 4 5 6 7 

1 0.0 37.4 35.0 63.0 652.3 1292.8 2203.8 

2 0.0 25.1 31.8 262.2 424.2 539.7 319.4 
. 3 231.0 174.1 266.8 471.6 1337.9 1014.8 1865.8 

A 93.3 179.2 130.8 362.2 1139.0 1523.0 1/61.7 

5 271.9 184.8 48.1 127.3 449.8 598.4 1886.2 

6 84.1 81.2 299.9 102.4 438.5 1038.5 1509.6 

7 100.8 85.6 99.5 220.3 450.1 399.6 932.8 

8 92.0 80.6 230.4 259.3 445.1 1847.3 728.1 
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APPENDIX C 

/ 

Average Pupil Tin^ Allocations to 
Major Content and Setting Categories 
by Class 
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Figure C.l Class 1^ Aggregate Content Areas Sums of Mean Time Allocation (n » 25) 
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Figure C.l (cont'd) 
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Figure C.2 C lass 2> Aggregate Content Areas Suras of Mean Time Allocation*^ (n ■ 19 ) 
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Figure C.2 (cont'd) _ * ' - 
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Figure C.3 Class'3. Aggregate Contenr Arpac gnme nf Moo,^ T^tn^ aii^^^^^^^ « 
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Figure C.3 (cont'd) ^ 
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Figure C.4.. Class 4. Aggregate Content Areas Sums of Mean Time Allocation ( n = 18) 
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Fi$?ure C.4, (cont'd) 
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Figure C.5. Class 5 /Aggregate Content Areas Sums of Mean Time Allocation ( n * 16) 
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Figyre C,5 (cont'd) 
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Figure C.6. Class 6, 
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Figure C.6. (cont'd) 
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Figure C.7. Class 7. Aggregate Content Areas Sum of Mean Time Allocation ( n « 19) 
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Figure C.7. (contM) 
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Figure C.8. Class 8, Aggregate Content Areas Sums of Mean Time Allocation .( n" 16) 
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Figure C.8. (contM) 
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APPENDIX D 
Teacher Rating Forms 



J9 



^ D-1 

0 



Rating of S tudent Attenti veness 



The lesson plan logs tf^l us how much tine was allocated by the teacher to 
different settings and objectives in reading or mathematics. But there is often 
i difference between the amount of time taken up by a lesson and the a.-nount ot 
time which is active learning time for a student. We would like to get a more 
accurate estimate o^ tne amount of actual learning t'.me for an ini^ividuai stu- 
dent. This will be used as a "correction factor" in the interpretation of the 
log information, 

A stude nt who is paying attent^ 'on works actively on assignments 

^ — — ^ participates or listens attentively 

\ ^ during class discussion 

A studen t who is not Paying attention talks to his neighbor 
J daydream-j 

draws pictures on his pape^ 

falls asleep 

walks around the room 

waits for help 

Children differ in the amount of time they pay attention in class. Based on 
your observations of th3 children so far thi> year, please rate each child in 
your class as to the percentage of tfme that chvld generally pays attention. 
Think only of the subject matte- for which >ou are keeping logs. If you arc 
keeping math logs, think about how much of the time a student pays attention 
during math lessons. If you are keeping reading logs, think of the time you 
record as reading or reading related. 

We suspect that children may differ in attenti veness depending on w^^^^'^^^^,^^ 
an adult is present. For this reason, we would li!ce you to rate ^^^^^^ 
First rate the childr-n for settings in which an adult is present (either ^^atwork 
with an adult supervising or group work w.th an adult). Then rate the children 
a second time for settings with no adult present. 

One way to go about tnis task is to go through the fpllowing steps: 

I. Think of a typvcal 40 or 50 minute lesson period. Think first ot 
settings where an adult is present to sup3rvis"e and encourage atten- 
tior During what percentage o^ the time would a student by likely 
to pay attention to the lesson?. On the form labeled/'AduU^re^.ent , 
assign each student a rating. ' 
2 Shift your thinking to a 40 or bO minute period where the students 
are left to work on their own without an adult. V.hat pcrccntuqe of 
the time would a stude.it be likely to pa> attenticn under the^e con- 
ditions^ Record your ratings on t^e forr Idbeled "No AduH ." 

Use many cr as fev of the categories you wifh to indicate tht^ differences 

in attent/veners amor g your students. The descriptions below mey help as 

guidelines. 



91-100% The child alr.ost always attends to the learning task. 

71-80» The child sometimes loses time through temporary in- 
attention or general classroom disruption but he tends 
to work more often than not. 

51-60t The child is as likely to be distracted as he js to work. 

Only about half the period is spent atttndim to the 
task. 

21-30% The chile- is frequently distracted ano inattentive. 

Large periods of time may be lost through inattention. 

The child may be noticeably disruptive in class or m<>y 

simply daydream a lot. 
0-10% The child almost never attends to the learning task. 
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Teacher's Name 



Rating of Student Attentlveness 



PUT A CHECK IN THE APPROPRIATE BOX 



Student 



Adult Present 

0-lW! 11-20% 21-30!i; 41-50% 51-60% 61-70% 71-80% 81-90% 91-100% 
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Teacher's Name 



Rating of Student Attentlveness 



PUT A CHECK IN THE APPROPRIATE BOX 



Student 



No Adult 

O-lOX n-20X 21-30t- 41-SOX ^ S1-60< 61-70< 71-80X 81-901 9M00X 
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